EFFICIENT HASHING METHOD 


Background of the Invention 

Field of the Invention 

The present invention relates to data manipulation; more specifically, the 
invention relates to an efficient technique for representing long strings of data as shorter 
strings of data. 

Description of the Related Art 

Hashing is a technique for representing longer lengths of data as shorter lengths of 
data. The techniques are such that there is a relatively small probability that two different 
longer lengths of data will be represented as identical short lengths of data. The feature is 
called a probability of collision. 

Pv(h(m l ) = h(m 2 ))<£ (1) 
2' 

The probability of collision is represented by Equation (1) which indicates that the 
probability of a hashing function "h" performed on a string mi being equal to the result 

of a hashing function "h" performed on a string m 2 being less than or equal to ~j or s. 

The number of bits contained in the longer unhashed string is "n" and is called a 
domain. The number of bits in the shorter or hashed string is "1" and is often referred to 
as the range of the hashing function. A hashing function that satisfies Equation (1) is 
often referred to as s universal. 
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Another property typically associated with hashing functions is represented by 
Equation (2) where it indicates that the probability of the difference between the output of 
a hashing function "h" on string xi and the output of a hashing function on string being 

equal to some preselected number A is less than or equal to or 8. Hashing functions 
that satisfy Equation (2) are typically referred to as s A universal hash functions. 
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Some hash functions also have a third property illustrated by Equation (3). 
15 Equation (3) shows that the joint probability of the output of hashing function "h" for 
input string xi being equal to a predetermined number Ci and the output of hashing 

function "h" for input string X2 being equal to predetermined number C2 is less than ^- or 

s . A hashing function that satisfies Equation (3) is referred to as 8 strongly universal. 
Hashing functions that satisfy Equation (3) automatically satisfy Equations (1) and (2). 

20 Hashing functions are used in many applications, one of which is to simplify 

searching for text strings. When used for searching for text strings, the hashing function 
is used to reduce the size of the stored information and then the same hashing function is 
used to reduce the size of the search criteria. The shortened search criteria is then used to 
search for the shortened stored information to more efficiently locate a desired piece of 

25 information. Once the desired piece of information has been located, the unhashed or full 
length text associated with the shorted text can be provided. 
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Hashing functions are also used in wireless communications for message 
authentication. A message is authenticated by sending a message string along with a tag, 
calculated by performing a cryptographic function on the message. Forming a tag of a 
message string is computationally intensive. Hash functions are used to shorten the 
5 message to a tag so that the cryptographic processing required is less intense. 
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Techniques such as linear hashing illustrated by Equation (4) and MMH hashing 
illustrated by Equation (5) are now used to represent longer strings of data or text as 
shorter strings where the probability of two different long strings producing the same 
short string is relatively small. These hashing functions require a multiplication of a key 
15 that is "w" words long by a "w" words long message or text that is to be hashed. As a 
result, w 2 operations are required to perform a hashing of a particular string of data or 
text. For large strings of data or text having many words, this results in a computationally 
intensive operation. 


20 Summary of the Invention 

2 
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The present invention provides an efficient hashing technique that uses — - — , 

operations to hash a string "w" words long rather than the v^operations of the prior art. 
The present invention achieves this efficiency by squaring the sum of the key and the 
string to be hashed rather than forming a product of the key and the string to be hashed. 

25 

h(m) = ((m + a) 2 mod p)mod 2' (6) 
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In one embodiment of the invention, as illustrated by Equation (6), a hashing of a 
message "m" is performed by summing the message string with a key string "a" and then 
forming the square of that summation. A modular "p" operation performed on the result 
of the squaring operation and a modular 2 1 operation is performed on the result of the 

5 modular "p" operation. In this case, both "m" and "a" are of the same length, that is, "n" 
bits or "w" words long. It should be noted that "a" may be longer than "n" bits, but "n" 
bits is preferable. The value "1" refers to the length in bits of the shortened string that 
results from the hashing and is referred to as the range. The value "p" is selected as the 
first prime number greater than 2 n where "n" is the number of bits in the message string 

10 "m". It should be noted that Equation (6) provides a hashing method that satisfies 
Equations (1) and (2), that is, the hashing method of Equation (6) is A universal. 


method is provided. In this case, message string "m" is summed with key "a" and then 
the resulting sum is squared. Both message string "m" and key "a" are "w" words long 
containing a total of "n" bits. It should be noted that key "a" may contain more than "n" 
bits, but "n" is preferable. The result of the squaring operation is then summed with a 

20 second key "b" which is at least "n" bits long. A modular "p" operation is performed on 
the sum of the squared term and key "b" as discussed above with regard to Equation (6). 
A modular 2 1 operation is performed on the result of the modular "p" operations as was 
described with regard to Equation (6). Using this hashing method provides a strongly 
universal hashing method that satisfies Equation (1), (2) and (3). 

25 In yet another embodiment of the present invention, "k" messages or strings are 

hashed so that a single shorter string is produced. 
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In the second embodiment of the present invention, a strongly universal hashing 
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Equation (8) illustrates the hashing function where "k" messages, each of which 
is "w" words long are hashed to form a single shorter string. Each message m\ is summed 
with a key aj and the resulting sum is squared. The result of the squaring operation for 
5 each message mj is then summed over the "k" messages. A modular "p" operation is 
performed on the overall sum, and a modular 2 1 operation is performed on the result of 
the modular "p" operation. The values "p" and "1" are once again defined as described 
above. The hashing method illustrated by Equation (8) produces a A universal hashing 
function that satisfies Equations (1) and (2). 

10 

Brief Description of the Drawing 

FIG. 1 is a flowchart of a square hashing method; 

FIG. 2 is a flowchart of a strongly universal square hashing method; and 

FIG. 3 is a flowchart of a second A universal square hashing method. 

15 

Detailed Description 

FIG. 1 illustrates a method for carrying out the square hashing method of Equation 
(6). In step 100 an input string or message "m" is inputted. In step 102 an input key "a" 
is inputted. The message or string "m" and the key "a" are each "n" bits long consisting 

20 of "w" words. Key "a" is a random or pseudo-random number and may be longer than 
"n" bits, but "n" bits is preferable. In step 104 the sum "s" of string "m" and key "a" is 
formed. In step 106 sum "s" is squared. In step 108 a modular "p" operation is formed 
on the result of step 106. "p" is the next prime number larger than 2 n ; however, "p" may 
be a larger prime which may degrade performance. In step 110a modular 2 1 operation is 

25 performed on the result of step 108. "1" is the number of bits in the short output message 
or string. In step 1 12 the result of the modular 2 1 operation is outputted. The process of 
FIG. 1 results in a message or string of "n" bits being reduced to a message or string of 
"1" bits. It should be noted that the process associated with FIG. 1 executes an 8 A 
universal hash function that satisfies the properties of Equations (1) and (2). 
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FIG. 2 illustrates a method for carrying out the strongly universal hashing method 
described by Equation (7). In step 140 a message or string "m" is inputted. In step 142 
keys "a" and "b" are inputted. Message "m", key "a" and key "b" are each "n" bits long 
having "w" words. In step 144 the sum of message "m" and key "a" is formed and stored 
5 as sum "s". In step 146 the square of sum "s" is stored as term "SQ". In step 148 the 
sum of the term "SQ" and key "b" is formed. In step 150 a modular "p" operation is 
performed on the result produced by step 148. Once again, "p" is equal to the next prime 
number greater than 2 n ; however, "p" may be a larger prime which may degrade 
performance. In step 152 a modular 2 1 operation is performed on the result from step 150. 

10 "1" is equal to the number of bits in the string or message to be outputted by this method. 
In step 154 the short message or string of length "1" is outputted. It should be noted that 
the method of FIG. 2 reduced a string or message of "n" bits to a string or message of "1" 
bits. It should also be noted that the process of FIG. 2 is an 8 strongly universal hash 
function that satisfies the properties of Equations (1), (2) and (3). 

15 FIG. 3 illustrates a method for performing the s A universal hashing method 

described by Equation (8). In step 170 index "i" is set equal to 1 and the variable SUM is 
set equal to 0. In step 172 the value of "k" is inputted, "k" is equal to the number of 
strings or messages that will be inputted to produce a single shortened message. In step 
174 message or string mj is separated, and in step 176 input key a\ is inputted. It should 

20 be noted that message or string mj and input key aj are of equal length and have "n" bits 
composing "w" words. Key "a*" is a random or pseudo-random number and may be 
longer than "n" bits, but "n" bits is preferable. Preferably, a; is a random number. 
Random numbers can be generated from many sources such as pseudo-random 
generators. In step 178 sum Sj is formed by forming the sum of message m\ and key a,. 

25 In step 180 the square of sj is set equal to variable SQi . In step 182 the variable SUM is 
set equal to the variable SUM plus SQi. In step 184 the value of "i" is checked to 
determine if it is equal to the value "k". If it is not equal to the value "k", step 1 86 is 
executed where the value of index "i" is incremented by "1" and then step 1 74 is 
executed. If in step 184 the value of "i" is determined to be equal to "k", step 188 is 

30 executed where a modular "p" operation is performed on the current value of the variable 
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SUM. As discussed previously, the value "p" is the next prime number greater than the 
value 2"; however, "p" may be a larger prime which may degrade performance. In step 
190 a modular 2 ! operation is performed on the results produced in step 188. Once again, 
"1" is the number of bits composing the output string or message. In step 192 the 
5 shortened message or string of "1" bits is outputted. It should be noted that the process of 
FIG. 3 reduced "k" messages of "n" bits each to one message of "1" bits. It should also be 
noted that the hashing method of FIG. 3 is a 8 A universal hashing method that satisfies 
the properties of Equations (1) and (2). 

In reference to FIGS. 1 , 2 and 3, it should be noted that the value "1" is typically 
10 chosen based on a trade-off between desiring a short output message of length "1" and the 
desire to minimize the probabilities of Equations (1) and (2) and in the case of an s 
strongly universal hash function, Equation (3). 

The following section provides an abbreviated proof showing that the disclosed 
squaring hash functions satisfies the properties for Equations (1), (2) and (3). 

15 

Theorem 1 : The hashing function described by Equation (6) is A - universal. 
Proof: For all m * neZ p , and A € Z p : 

20 

P x r[h x (m) - h x (n) = A ] (1) 

= P x r[(m + x) 2 -(n + x) 2 = A] (2) 
= P x r[(m 2 - n 2 + 2(m-n)x = A] (3) 
25 = 1/p (4) 

Where the last inequality follows since for any given m * n e Z p and 8 e Z p there is a 
unique x which satisfies the equation m - n + 2(m-n)x = 8 . 

30 
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Theorem 2: The hashing function described by Equation (7) is a strongly universal 
family of hash functions. 


5 Proof: Follows as an immediate corollary of the following lemma which shows how to 
convert any A - universal family of hash functions into a strongly - universal family of 
hash functions. 

Lemma 1 : Let "h" = {h x : D R\xe K} ? where R is an abelian group and "k" is the set 
10 of keys, be a A - universal family of hash functions. Then 

H' = \h' xh : D -> R\xeK,beR] defined by h' xb (m) = (h x (m) + b) (where the 

addition is the operation under the group R) is a strongly universal family of hash 
functions. 

15 Proof: For all m * ne D and all a , P e R: 


Pr [h' xJb (m)=a,h' xJf (n)=fi] (5) 


= Pr [h x (m) + b=a,h x (n) + b=/?] 


(6) 


20 


= Pr [h x (m) - h x (n) = a -/?, b = a - h x (m)] 


(7) 



25 


= i/|R| 2 (9) 
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The last equation follows since h x is a A - universal hash function and h x (m) - h x (n) can 
take on any value in R with equal probability. 
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